Goto

Collaborating Authors

 physics simulation engine


From Word Models to World Models: Translating from Natural Language to the Probabilistic Language of Thought

arXiv.org Artificial Intelligence

How does language inform our downstream thinking? In particular, how do humans make meaning from language--and how can we leverage a theory of linguistic meaning to build machines that think in more human-like ways? In this paper, we propose rational meaning construction, a computational framework for language-informed thinking that combines neural language models with probabilistic models for rational inference. We frame linguistic meaning as a context-sensitive mapping from natural language into a probabilistic language of thought (PLoT)--a general-purpose symbolic substrate for generative world modeling. Our architecture integrates two computational tools that have not previously come together: we model thinking with probabilistic programs, an expressive representation for commonsense reasoning; and we model meaning construction with large language models (LLMs), which support broad-coverage translation from natural language utterances to code expressions in a probabilistic programming language. We illustrate our framework through examples covering four core domains from cognitive science: probabilistic reasoning, logical and relational reasoning, visual and physical reasoning, and social reasoning. In each, we show that LLMs can generate context-sensitive translations that capture pragmatically-appropriate linguistic meanings, while Bayesian inference with the generated programs supports coherent and robust commonsense reasoning. We extend our framework to integrate cognitively-motivated symbolic modules (physics simulators, graphics engines, and planning algorithms) to provide a unified commonsense thinking interface from language. Finally, we explore how language can drive the construction of world models themselves. We hope this work will provide a roadmap towards cognitive models and AI systems that synthesize the insights of both modern and classical computational perspectives.


Gym-preCICE: Reinforcement Learning Environments for Active Flow Control

arXiv.org Artificial Intelligence

Active flow control (AFC) involves manipulating fluid flow over time to achieve a desired performance or efficiency. AFC, as a sequential optimisation task, can benefit from utilising Reinforcement Learning (RL) for dynamic optimisation. In this work, we introduce Gym-preCICE, a Python adapter fully compliant with Gymnasium (formerly known as OpenAI Gym) API to facilitate designing and developing RL environments for single- and multi-physics AFC applications. In an actor-environment setting, Gym-preCICE takes advantage of preCICE, an open-source coupling library for partitioned multi-physics simulations, to handle information exchange between a controller (actor) and an AFC simulation environment. The developed framework results in a seamless non-invasive integration of realistic physics-based simulation toolboxes with RL algorithms. Gym-preCICE provides a framework for designing RL environments to model AFC tasks, as well as a playground for applying RL algorithms in various AFC-related engineering applications.


Anyone can use NVIDIA's physics simulation engine

Engadget

NVIDIA isn't just showing off its Titan RTX GPU and some clever AI demos -- it also has big news for anyone interested in more realistic computer physics. The company is releasing its hardware-accelerated PhysX simulation engine as an open source project, making it accessible to virtually everyone. It's a recognition that the technology is useful for more than just convincing game physics, NVIDIA said. PhysX can help with more accurate AI and robotics simulations, including self-driving car technology. You could see vehicles and bots that are better-prepared for real-world conditions. The company has simultaneously unveiled the PhysX 4.0 toolkit, which promises faster and more accurate physics that goes beyond the technology's gaming foundations.